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Abstract Cooperation or defection and participation or withdrawal are well- 
known options of behavior in game-like activities in free societies, yet the co¬ 
evolutionary dynamics of these behavioral traits in the individual level are not 
well understood. Here we investigate the continuous voluntary public good 
game, in which individuals have two types of continuous-valued options: a 
probability of joining the public good game and a level of cooperative in¬ 
vestment in the game. Our numerical results reveal hitherto unreported phe¬ 
nomena: (i) The evolutionary dynamics are initially characterized by oscil¬ 
lations in individual cooperation and participation levels, in contrast to the 
population-level oscillations that have previously been reported, (ii) Eventu¬ 
ally, the population’s average cooperation and participation levels converge 
to and stabilize at a center, (iii) Then, a most peculiar phenomenon unfolds: 
The strategies present in the population diversify and give rise to a “cloud” of 
tinkering individuals who each tries out a different strategy, and this process 
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continues unchecked as long as the population’s cooperation and participa¬ 
tion levels remain balanced. Over time, however, imbalances build up as a 
consequence of random drift and there is a sudden and abrupt collapse of the 
strategy-diversity cloud. The process then repeats again in a cyclic manner. To 
understand the three aforementioned phenomena, we investigate the system 
analytically using adaptive-dynamics techniques. Our analysis casts light on 
the mechanisms which underpin the unexpected and surprising evolutionary 
dynamics. 

Keywords social dilemmas • evolution of cooperation • voluntary participa¬ 
tion • adaptive dynamics • diversification 

Mathematics Subject Classification (2010) 91A06 • 91A22 • 91A40 


1 Introduction 

The reasons for the emergence and maintenance of cooperative behavior is 
an enduring puzzle in biology and the social sciences [1,210,4 . The nature of 
this puzzle is often characterized as follows: groups of cooperators outperform 
groups of defectors, but defectors always outperform cooperators in any mixed 
group [5]. This represents a social-dilemma situation: individual interests and 
the communal benefit are incompatible. Many theoretical and experimental 
investigations of cooperative behavior have employed the framework of the 
public goods game 00 . Typical public good games can be described as follows: 
cooperators in an A/'-player group with N > 2 invest the same amount c > 0 
to a public pool and defectors do nothing at all; then, the total amount of 
investment is multiplied by a factor r > 1 and distributed equally among all 
members of the group despite the preceding different investment levels [5]. 
With r < AT, it follows that the marginal profit c(r/N — 1) is negative and 
thus each player is better off defecting than cooperating, irrespective of the 
other players decisions, i.e., defection dominates cooperation. Cooperators are 
thus evolutionarily doomed by defectors. This is in contrast to the case r > N 
in which each player is better off cooperating and, consequently, no social 
dilemma exists. 

Here we focus on the effects of voluntary participation (or exit) on the evo¬ 
lution of cooperation pirronuis] . In modern societies individuals often have 
a great deal of freedom and anonymity. This allows an individual to get away 
with not only free-riding, but also opting-out types of behavior. Voluntary 
participation appears to be the simplest mechanism for promoting coopera¬ 
tion that can be justified as an a priori option even under complete anonymity. 
This mechanism has been studied in the standard voluntary public good game 
consists of three pure strategies: cooperation, defection, and nonparticipation. 

The latter strategy is used by players who opt out of public good games 
and instead constantly earn a payoff a > o mm- if successful strategies are 
assumed to increase in frequency, for example through imitation dynamics, 
a “rock-scissors-paper”-type rotational change in dominating strategy arises 
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among the three pure strategies. Cooperation can therefore be maintained 
through population-level oscillations in the relative frequencies of these three 
pure strategies. 

The standard voluntary public goods game assumes that each player has 
one of three pure behavioral strategies ram- In many situations, it is more 
plausible to assume that players differ continuously in cooperative investments 
and participation probability, but the consequences of this assumption has 
thus far not been explored. Here, we investigate a continuous voluntary public 
goods game in which individuals are able to make continuously varying degrees 

participation rates |27U2B] , Surprisingly, we find that the emerging cooperative 
dynamics are very different from those of the standard public good game and 
in particular involve a hitherto unreported phase of strategy expansion and 
collapse. By drawing on both evolutionary game theory and the theory of 
adaptive dynamics, we can analytically understand and explain almost all of 
the unfolding phenomena, thus revealing important insights for the evolution 
of cooperation. 

This paper is organized as follows. In Sect. 2, we describe a continuous 
voluntary public good game and provide an individual-based model of the 
gradual evolution of cooperation and participation in public good games. In 
Sect. 3, we conduct numerical simulations of the individual-based model which 
demonstrate cyclic oscillation, convergence to the center, growth of “cloud” 
and its collapse. In Sect. 4, we then compare those results with the theoretical 
predictions. We determine the expected payoff and invasion fitness and analyze 
the selection gradient and equilibria for monomorphic populations. To explore 
effects of small yet finite mutations, we also consider a geometrical analysis and 
polymorphic populations. Finally, in Sect. 5, we provide further discussion. 


2 Model description 

2.1 Continuous voluntary public good game 

We consider a well-mixed population. An individual has a continuous strategy 
involving two traits (c,p) in U := [0, l] 2 . The first coordinate c represents the 
amount of investment that the individual makes in the public good game. The 
second coordinate p represents the probability of participation in this game. 
For each game N individuals with N > 2 are randomly selected from the 
population. Each of the Wplayers first determines whether to participate in 
the public good game or not, with one’s own probability p. Those who par¬ 
ticipate can contribute an investment at a cost c to themselves. All individual 
contributions are added up and multiplied with a factor r with r > 1. This 
amount is then shared equally among all participants. Each participant’s pay¬ 
off is given as a net benefit that consists of his or her share less the amount 
invested. Individuals who do not participate in the public good game instead 
receive a small payoff a with 0 < a < r — 1 that is independent of outcomes 
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of the public good game. We require a > 0 to ensure that nonparticipation is 
better off than a group of those who make no investment (c = 0), and that 
a < r — 1, that a group of those who make full investment (c = 1) is better off 
than nonparticipation. We assume that if there is only one participant, this 
single player has to act as a nonparticipant and therefore the payoff is a. 

It is well known that in the case of compulsory participation (p = 1 for all 
individuals), no contribution with c = 0 is only Nash equilibrium for r < N 
[23j . A focal participant io with c = Co will earn in a game with N — l co-players 
with cooperation levels {ci, • • • ,cat-i} the payoff P(io) = ^ Ylk=o c k ~ c o- 
Thus, the marginal profit per unit increase in the focal player’s contribution is 
given by dP/dco = r/N — 1. With r < TV, this is negative and each participant 
is tempted to reduce own contribution to zero: c = 0 is (weakly) dominant, or 
with r > TV, the marginal profit is positive and c = 1 is (weakly) dominant. 
Therefore, we hereafter concentrate on the most stringent case with r < N. 

2.2 Individual-based model 

In the individual-based model, strategies spread in a finitely large popula¬ 
tion with size M by imitation and exploration (“social learning”). We assume 
that individuals are more likely to imitate strategies of those who have earned 
higher payoffs. For simplicity, we straightforwardly apply the replicator dy¬ 
namics to the finite population as in Doebeli et al. [20] , 

We consider asynchronous sequential updating of the finite population, as 
follows. First, a focal individual io is randomly picked up from the population. 
The io’s payoff P(io), then, is determined through an interaction with N — l 
co-players selected randomly, {ii,--- ,z at— l}* After making a participating- 
decision with one’s own participation rate, the focal individual’s payoff is set¬ 
tled as 



(i) 


otherwise, 


where Ck denotes the i/ds investment level and the first to ( S — l)-th players 
among the N — l co-players (1 < S < N) are participants. 

For comparison, another model individual jo is randomly chosen, and then, 
its payoff P(jo) is determined as in Eq. (jTJ) through an interaction with random 
N — l co-players selected independent of the zq’s case. Whether the focal 
individual io imitates the model jo is determined with a probability w that 
is proportional to those payoff difference: w = p ^o)~ p M P(j 0 ) > P(i 0 ); 

otherwise, if P(jo) < P(i o), re = 0. In the former case, a is fixed as r ^ N ~^ — 
(-^ —1), which denotes the maximum degree among available payoff differences, 
and thus, ensures that w < 1. Its first term represents the payoff of a full- 
defector (with c = 0) within N—l full-cooperators (with c— 1), and the second 
term represents the payoff of a full-cooperator within N — l full-defectors. 
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Steps Steps 


Fig. 1 Evolutionary history consisting of oscillation and dispersal. The initial state is 
monomorphic at (c,p) = (0,0). Mean investment level c (a), mean participation rate p (b), 
standard deviations of investment levels (black) and participation rates (red) (c), and 100- 
step moving average of the correlation between the two traits c and p (d) are provided. 
Coevolution of cooperation and participation is characterized by transitions between the 
oscillation (white intervals) and dispersal (gray intervals) phases. The mean and the standard 
deviation of investment levels first increases gradually because of neutral drift along the 
boundary p = 0, and the mean participation rate p remains close to 0, and then, increases 
rapidly when the mean investment c reaches about 0.5. After cycles for about 0.7 x 10 5 
steps, the population attains a small neighborhood of the center Q. Interestingly, from 
0.7xl0 5 to 0.9xl0 5 steps, another dynamical phase ensues, in which (c,p) is close to Q and 
slightly oscillates with quite a small amplitude. Insufficient selection pressure there allows 
the trait distribution to spread and increase in variance. Another dispersal phase appears 
between 1.1 xlO 5 and 1.2 xlO 5 steps after the second oscillation phase. From c and d one 
can observe that diversification can subsequently continue when the trait distribution keeps 
its correlation sufficiently negative. In particular, the second dispersal phase shows that a 
sudden contraction of diversity could occur when the negative correlation is lost. Parameter: 
M = 10 4 , p = 0.001, s = 0.005, N = 5, r = 3, and a = 1. 


Finally, after the imitation event, the exploration can happen with a small 
probability /i. In the case each trait is replaced by a value drawn independently 
from a Gaussian distribution with the former value of the trait as mean and 
a small standard deviation s. 


3 Results 

The individual-based model can embody surprisingly rich evolutionary pro¬ 
cesses. These are characterized by transitions between two qualitatively differ¬ 
ent dynamic phases, cyclic oscillation and diagonal dispersal. Figure [T] presents 
a typical sequence of the oscillation and dispersal phases and those correspond- 
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Investment level, c 


Fig. 2 Snapshots of the oscillation phase corresponding to Fig. ^ (up to 14,500 steps). 
Each panel shows a snapshot of the frequency distribution of strategies (from high to low: 
red, orange , yellow , green , blue , white (for 0)) in the (c, p) space at a certain step. The 
interior equilibrium Q is located at the intersection of the dashed nullclines c = 0.5 and 
p w 0.5387, beyond which the selection pressure on p and c, respectively, changes. The 
population is initially monomorphic at (c, p) = (0, 0). Neutral drift first drives diversification 
of the investment level c along the boundary p = 0. As the distribution reaches around the 
point (0.5,0), mutants with c > 0.5 and p > 0 can happen and then successfully invade. 
Such mutants eventually displace the residents, and monomorphism is re-established. From 
there the population synchronously orbit the center Q. The orbit present is so distant from 
Q that the boundary p = 0 absorbs it at the end. Then, neutral drift along p = 0 begins, 
again. 


ing snapshots are displayed in Figs. [2] and [3j respectively. In particular, Fig. 
0 ] demonstrates a trial in which investment levels largely diverge into full co¬ 
operation (c = 1) and defection (c = 0) (see also corresponding snapshots in 
Fig. [5j). We now explain each of the two dynamic phases in turn. 

(i) Cyclic oscillation. Let the population start with a monomorphic state in 
which all individuals adopt the same state as (c,p) = (0,0) (Figs, [l] and 
E>. In the situation, any mutant with respect to the investment level c 
is able to invade the resident through neutral drift, leading to a gradual 
increase in the deviation of c, while the participation rates p are kept to 
a low level corresponding to the probability (i and standard deviation s 
of explorations. Then, about when the strategy distribution reaches the 
critical investment level cq given by cr/(r — 1) in Sect. 4.1, beyond which 
the sign of the selection pressure on p changes, the widely spaced residents 
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Investment level, c 


Fig. 3 Snapshots of the dispersal phase corresponding to Fig. (from 107,050 to 114,530 
steps). Panel features are the same as for Fig. [2 The cluster is already close to the center 
Q at 107,050 steps. After converging to Q, the gradual radiation derived from neutral ex¬ 
plorations starts across Q while its trend remains negative. This dispersal process leads to 
splitting the residents into some distant subclusters after 112,000 steps. Finally, the lower- 
right cluster that plays a major part in keeping the trend negative, vanishes accidentally. 
This subsequently causes a dramatically rapid contraction of diversity, and then, the popu¬ 
lation returns to monomorphism (114,530 steps). 


along the line p = 0 are displaced by the invasion of a mutant with c > cq 
and p > 0, converging to a nearly homogeneous cluster quite rapidly. 
When once leaving the line c = 0, monomorphic populations should move 
along the orbits determined by the fitness landscape for a rare mutant 
invading at the resident traits (called “selection gradient”, D(x) in Eq. 
©), which revolve around the center Q. We remark that in the individual- 
based model the orbit the population travels on would first be stochastically 
selected, depending on the former invading mutant. Then, for orbits further 
out, the population will eventually be absorbed to the boundary pm 0 after 
orbiting, and again, be exposed to the effect of the neutral drift. 

(ii) Convergence to the center. When orbits further in have been selected, the 
directional selection pressure becomes so weak that the effects of the non¬ 
zero correlation between the two traits are relatively considerable. Cycles 
around the center Q can be observed in individual-based simulations for 
typical sets of parameters for the standard voluntary public good game [13 
m. According to the numerical investigations, the population is certain 
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Dispersal Oscillation 



Fig. 4 Evolutionary history consisting of oscillation and dispersal. The initial state is 
monomorphic at the center Q. Other parameters and panel features are as in Fig. ^ In this 
trial a quite large standard deviation in the investment level c appears from 20,000 to 35,000 
steps. As is shown in Fig. [5j complete branching into both the extreme levels c = 0 and 
c = 1 ensues while the negative correlation between the two traits remains. 


to reach a sufficiently small vicinity of Q sooner or later, differently of 
the deterministic prediction by the canonical equation. In the case the 
population faces the next dispersal phase. 

(ii) Growth of the cloud and its collapse. After converging to Q, the cluster 
starts radiating gradually. Some kinds of disturbance (e.g., arising from 
finite population sizes) cause biased spreading, such that even if it is only 
minor, minute fluctuations of the frequency distribution can occur, as ob¬ 
served in each dispersal phase (a, b of Figs. [1] and Hj). Although the out¬ 
comes of such fluctuations are difficult to predict analytically, the numeri¬ 
cal simulations demonstrate that the diversified distribution survives when 
there has been a negative correlation between the two traits c and p, or 
otherwise, does not. 

Indeed, the first dispersal phase in Fig. [1] shows that the standard devia¬ 
tions repeat a small growth-and-decline cycle simultaneously, but neither 
has developed to a significant level. Then in the second dispersal phase, 
there is distinct development of diagonally located clusters (see also Fig. 
i) with a negative slope. If the diagonal dispersal goes further as shown in 
Figs. [Hand 0 the resulting population can branch into two distinct clusters 
quite distant from each other across Q and there is long-run maintenance 
of a negative correlation over more than 30,000 steps. 

The minute fluctuations remain throughout the dispersal phase, and are 
likely to affect clusters relatively closer to Q. Such an affected cluster then 
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Investment level, c 


Fig. 5 Snapshots of the dispersal phase corresponding to Fig.0](from 7,400 to 42,300 steps). 
Panel features are the same as for Fig. [2] Two clusters that are distant from each other on 
either side of Q emerge after 12,500 steps, and then evolve into two distinct branches, each of 
which lies close to a pure strategy state, that is, full cooperation (c = 1) or defection (c = 0). 
The right subcluster closer to Q becomes more widely distributed after 35,000 steps. After 
the left cluster vanishes (41,000 and 42,200 steps), the diversity quickly contracts, and then 
the population returns to monomorphism around Q (42,300 steps) (see also Fig. [3}. 


becomes more dispersed (sometimes splitting into subclusters). As a result, 
the local trend that is restricted to such a dispersed subgroup may be 
positive while the global trend still remains negative. This can cause an 
increase in the amplitude of fluctuations and the instability of the global 
population dynamics, often leading to extinction of some clusters. One can 
observe bursts of fluctuations that result in the diversity of the distribution 
being lost, as shown in Figs, [l] and 0J However, if a cluster that vanishes 
has played a major part in maintaining the negative trend overall (see 
Fig. [3j 114,490 steps; Fig. [5j 41,000 and 42,200 steps), then there can be 
an incidental change to a positive trend. The positive correlation leads 
the diversified population to abruptly contract, often to a nearly uniform 
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state. The location to which the distribution has contracted is often so far 
from the center Q that directional selection drives the population instead 
of neutral drift. We thus return to the cyclic oscillation phase. 

We have also checked that the evolutionary history with both oscillation 
and dispersal as in Fig. [I] can happen for other parameters close to those for 
Fig.[lJ including large exploration probability 0.05. We note that the dispersal 
phase is subdued compared to cases with high exploration probability p or 
large standard deviation of explorations s. By contrast, the oscillation phase 
is largely unaffected by changes in the exploration parameters p and s. 


4 Analysis 

Two complementary approaches are used for studying evolutionary dynam¬ 
ics of continuous games: replicator dynamics on probability distributions of 
strategies |29] and the canonical equation of adaptive dynamics EDI. In the 
former approach, all strategies are present in the population at all times, while 
in the latter only certain resident strategies are present and other strategies 
are tried out occasionally through tinkering with investment and participation 
levels. In this section we use the mathematical framework of adaptive dynam¬ 
ics p3Q[l3Tll32ll33] to analyze the evolution resulting from the individual-based 
model. 


4.1 Cyclic oscillation 
Invasion fitness 

We consider an infinitely large population and assume that at regular intervals 
N individuals with N > 2 are randomly selected and offered the option to 
participate in the public good game. Consider a monomorphic resident in 
which each individual uses the same strategy x = (c x ,p x ). Let us introduce 
invasion fitness S(x,y), that denotes the growth rate of a mutant strategy 
y = (cy,p y ), in the monomorphic resident. We assume that the growth rate 
of a rare mutant in a resident population is determined by the replicator 
dynamics. We can thus obtain an expression for the invasion fitness for the 
rare mutant within the resident population as follows: 

S(x,y) = P(x,y) — P(x), (2) 

where P(x,y) describes the expected payoff of the mutant player with y inter¬ 
acting with the other N — 1 resident players with x, and P(x) expresses the 
average payoff over the resident population (and thus P(x) = P(x,x)). In the 
model it is convenient to define by g(x,y) the mutant’s expected payoff when 
the mutant participates in the public good game with its own probability p y . 
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Using this and the nonparticipant’s payoff <7, the mutant’s expected payoff is 
given by a linear equation with respect to p y : 

P(x,y)=p v g(x,y) + (l-p y )a. (3) 

See Eq. (IA.1I) in Appendix A.l for details of g(x,y). This yields 

P(x,y) = a+(r-l)(c x -c Q )(l-(l-p x ) N ~ 1 )py-(cy-c x )p y F(l-p x ), (4) 

in which cq m a/(r — 1) and 

F(«) = l+(r-l)/- 1 -|^. (5) 

We note that the set of roots of F(z) in [0,1] is only z = 1 for r < 2, and in 
addition there is a unique interior root zq for r > 2 [14]. Then we find that the 
invasion fitness in Eq. © is linear in the mutant traits c y and p y , as follows, 

S(x,y) = a 10 (x)(c y - c x ) + a 01 (x)(p y - p x ) + au(x)(c y - c x )(p y - p x ), (6) 

where a 10 (x) = -p x F(l-p x ), a 0 i(x) = (r - l)(c x - c Q )(l - (1 -px)^ -1 ), and 
ail 0*0 = -F(l-p x ). 


Selection gradient 


The adaptive dynamics of the resident strategy x is governed by the selection 
gradient as below, with the exception of the vicinity of its equilibrium points. 


D{x) 




dS(x,y ) 

d Cy 


y=x 


dS{x,y) 
\ d Py 


faio(x)\ 


(7) 


so that x = D{x). An example is given in Fig. [6] This vector associated with 
strategy x points in the direction of the maximal increase of the mutant’s 
advantage over the resident population: D(x) suggests the most favorable di¬ 
rection. In general, the adaptive dynamics for monomorphic populations with 
strategy x is expressed using its canonical equation x = kVD(x ), where V 
is the variance-covariance matrix of the difference vector between the mutant 
and its parent, and the coefficient k depends on the equilibrium for the pop¬ 
ulation size and the mutational process j30ll3Tll35] . From the assumptions of 
the individual-based model, hereafter we analyze the canonical equation with 
kV = 1 (unit matrix). The system being considered is 


c= -pF(l-p), (8) 

p = (r-l)(c-c Q )(l - (1-p)^- 1 ), (9) 

which result in that every orbit has the line of symmetry c = cq. We focus on 
the upper half plane p > 0, excluding the exceptional line p = 0, a continuum of 
equilibria. In the case r < 2 (Fig. |6]b) , this plane is filled with the orbits issuing 





12 


Tatsuya Sasaki et al. 


from the one half of the p -axis {c > cq,p = 0 }, moving counter-clockwise 
around the point (cq,0), and converging to the other half {c < cq,p = 0 }. 
When an orbit converges to the boundary of the strategy space, we assume 
that the orbit then is governed by the selection gradient naturally projected 
to the boundary. For instance, in Fig. [ 6)0 an orbit contacting the line c = 0 
will move along this line with decrease in p, converging to p = 0 . 

We then turn to the case that r > 2 (Fig. [ 6 ^) (see m for the discrete 
voluntary public good game). Dividing the right-hand sides in Eqs. (j8j) and 
© by 1 — (1 — p) N 1 , which corresponds to a change of velocity, thus does 
not affect the orbits on the subspace. This yields 


pF(l-p) F(l-p) 

( l-(l-p)N-i 

P=(r- l)(c- c Q ). 


( 10 ) 

( 11 ) 


We define these as —g(p) and /(c), respectively. We then introduce H(c,p) := 
G(p) + L(c), where G(p) and L{c) are primitive functions of g{p) and /(c), 
respectively. The function H is a constant of motion: H = ^c + Q^-p = 0. 
The Hessian of H is symmetric positive definite (and thus H attains a strict 
minimum) at the point Q = (cq,pq), where pq equals 1 — zq. We have used 
the fact that F(zq) = 0 and F'(zq) < 0 !M . Therefore, a neighborhood of Q 
is filled with closed periodic orbits. 

To see the global dynamics, we explore the vicinity of the boundary point 
(cq , 0). The Jacobian for Eqs. (flQl) and CD at this point is given by 




( 12 ) 


We note that F'( 1) = (| — 1)(N — 1) > 0 for r > 2, in which case it follows that 
the matrix has two real eigenvalues of different sign and thus the equilibrium 
(cq, 0) is a saddle point. For p > 0, the orbits in the vicinity of the saddle point 
agrees with the orbits associated with Eqs. © and ©• Moreover, considering 
the symmetry to the line c = cq , the separatrices for the saddle point connect 
each other and comprise the critical level set surrounding Q; its inside is filled 
with the closed periodic orbits, and its outside is filled with heteroclinic orbits 
issuing from the one half of the line {c > cq,p = 0 }, turning around Q, and 
returning to the other half {c<cq,p = 0}. 


Singular strategies 

Equilibrium points of the selection gradient are called singular strategies, and 
they are given by solutions of D{pc) = 0 . If the monomorphic population takes 
a singular strategy, the selection pressure on both the directions of c and p 
vanishes; otherwise, the monomorphic population is always under directional 
selection. From Eqs. © and ©, it follows that singular strategies of the 
continuous voluntary public good game are given by the boundary line p = 0 , 
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and for r > 2, also the point Q. The dynamic analysis implies that Q is a center 
surrounded locally by periodical closed orbits [36], and as long as mutants arise 
infinitesimally rare and near, the monomorphic population on the cyclic orbit 
should not reach the center Q. 

For r > 2, the c-coordinate of Q, cq = cr/(r — 1), increases with the non¬ 
participant’s payoff a and decreases with increasing the multiplication factor 
r. Changes in the group size N do not affect the c-coordinate of Q. In the 
case of its p-coordinate, pq, we know from the differential (or difference) of F 
in Eq. © with respect to r or iV, that F( 1 — p) decreases with increasing r 
and increases with N. Considering that F(1 — p) is positive for pq < p < 1 or 
negative for 0 < p < pq p3], thus the value of unique interior root pq must 
increase with r and decrease with increasing N. 

If x is a singular strategy among Q and p = 0, the invasion fitness de¬ 
generates, that is, S(x,y) = P(x,y) — P(x,x) = 0 holds for all strategy y 
in the strategy space U. (We note that P(x,y) = a = P(x,x) if x = Q or 
p x = 0.) This implies that Q and each point of p = 0 are (symmetric and not 
strict) Nash equilibria and from the equality any mutant strategy may first 
through neutral drift invade a resident population with the singular strategy. 
In Appendix A.3 we fully analyze the replicator dynamics for two distinct 
strategies in the continuous voluntary public good game. Indeed, we have that 
S(Q,u) = 0 and S(u, Q) < 0 for all strategy u within {c < cq,p > pq} or 
{c>cq,0<p<pq}. Considering Eq. (|A.33[) , this indicates that the strate¬ 
gies Q and u are mutually invasible in the replicator dynamics. In the case of a 
resident population with p = 0, then any mutant y within {c > cq,p > 0} can 
invade and eventually replace the resident nonparticipation strategy. There¬ 
fore, neither Q nor p = 0 is an evolutionary stable strategy (ESS) [37, 38] and 
thus satisfy any of the following properties: evolutionary robust strategy [29] . 
strongly uninvadable strategy [35], and continuously stable strategy (CSS) [40] , 
In addition, if its initial fraction £ is sufficiently small, the mutant strategy 
Q is not able to invade any nearby resident population in {c > cq,p > pq} 
or {c < cq,0 < p < pq}. Also considering that neutrality among strategies 
with p = 0, this implies that neither Q nor p = 0 is an neighborhood invader 
strategy (NIS) |41| . The singular strategies above are not always effective to 
invade a nearby resident population. 

When the population is monomorphic with strategy Q, then the canonical 
equation, based on infinitesimal small mutations, is not able to predict the 
evolutionary dynamics, because of the flatness of invasion fitness (S(Q,y) = 0 
for all y in U) and substantial effects of neutral drift, instead of directional 
selection. Indeed, with considering a more realistic situation in that explo¬ 
ration is not always small and emergent innovation happens [42] , evolutionary 
dynamics can more easily result in branching and polymorphism |43ll44ll45l 
I46ll471148| . For instance, in a sufficiently small neighborhood of Q directional 
selection is so weak that a next exploration would occur before substitution of 
the resident strategy has been completed. For last decade fundamental tech¬ 
niques to investigate convergence and stability for multi-dimensional adaptive 
dynamics have been developed mm- Yet satisfactory analyses of evolution- 
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Investment level, c 


Fig. 6 Selection gradient depicted by Eqs. © and © for IV = 5, and in a, r = 3 and 
(7 — 1, or in b, r — 1.8 and cr = 0.4. A set of singular strategies consists of the point 
Q(0.5,pq) and the line p = 0 (pq « 0.5387) in a or only the line in b. (a) The point Q is a 
center surrounded by closed orbits. The point (0.5, 0) divides the boundary line p = 0 into 
a left segment of stable fixed points (Lyapunov stable; closed circles) and a right segment 
of unstable fixed points ( open circles), (b) The strategy space U is filled with the orbits 
connecting the right segment of p = 0 (or the line c = 1) and left segments of p = 0. 

ary diversification around a non-ESS singular strategy, in particular like the 
center Q, have not been published. In the following section, accordingly, to 
investigate effects on cyclic orbits of small, but finite mutations, we will ex¬ 
pand the analysis of adaptive dynamics to the neutral direction along normal 
vectors of the selection gradient. 


4.2 Convergence to the center 

Here we will provide a geometrical analysis of local evolutionary dynamics and 
classify the strategy space U into four regions, depending on the abilities to 
invade and to be invaded for a given strategy |5E. Of particular interest is 
to explore whether there is a meaningful trait region in which evolutionary 
branching can happen. Coupling these abilities generates a two-dimensional 
pairwise invasibility plot [31], clarifying what type of evolutionary scenarios 
happen between minor mutants and major residents. 

From the arrangement of the singular strategies and isoclines, the subspace 
of U, in which both the directional selection pressure do not vanish, are nat¬ 
urally divided to four types of quadrant around Q, I = {c > cq,p > pq}, II 
= {c < CQ, p > pq}, III = {c< CQ,p < pq}, and IV = {c > c Q ,p < p Q j. Let 
us look the curve C m = {(c y ,p y )\S(x,y) = 0}, which goes through the given 
focal point x and separates regions of (mutational) strategies that can invade 
into the resident population with x from strategies that cannot. Equation ([6]) 
yields that C m is a hyperbolic curve for all points x in U except x = Q, as 
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Table 1 Sign configurations of indexes for geometric analysis 


regions 

I 

II 

Ill 

IV 

aoi Or) 

+ 

- 

- 

+ 

an(x) 

- 

- 

+ 

+ 

slope: p' y (x) 

+ 

- 

+ 

- 

Km(x) 

+ 

+ 

+ 

+ 

K r (x) 

- 

- 

+ 

+ 

Kr(x) ~ Km(x) 

- 

- 

+ 

+ 


follows: 


Py 



QoiQeA I / a 0 i(x) \ 

ail Or) A Px \an(x)J 


< 0 if x G I U III, 
> 0 if x G II U IV. 


(13) 


The asymptotic lines of the hyperbola C m are thus given by p y = 0 and 
c y = c x — aoi(x)/an(x). The asymptotic line p y = 0 means that all we need 
to consider is the upper one of two connected components of the hyperbola, 
because the lower one is located entirely out of U. Then, let us consider the 
curve C r = {(c y ,p y )\S(y, x) = 0}, which separates (resident) strategies that 
can be invaded by a given mutant with x from strategies that cannot. It is 
obvious that C r goes through x and Q. We analyze C r locally in the neighbor¬ 
hood of x. From a straightforward calculation, we can obtain that C r and C m 
have identical slopes at x. So, to clarify the local arrangement of C m and C r , 
there remains only an investigation of these second order approximations be¬ 
cause Cm is a quadric curve. Appendix A.2 provides calculations of curvatures 
and K r (x) of C m and C r at x, respectively, and estimations of signs of 
these curvatures and the difference between them. Signs of all indexes we need 
to consider are displayed on Table [T| and organized by the four quadrants I, 

II, III, and IV. 

From Table [TJ we can obtain complete information about possible combina¬ 
tions of the signs of S(x, y ) and S(y , x) in the vicinity of a focal point x. Figure 
[7]provides typical plots of C r and C m , and configurations of (sgn S(x, y ), sgn S(y, x)) 
According to Appendix A.3, in the continuous voluntary public good game the 
type of frequency dynamics between any two strategies x\ and x<± can be deter¬ 
mined by (sg nS ( X 2 , x \), sgmS (x \, X 2 )). As such, the case of (sgmS(x, y ), sg nS(y,x)) 
(+, —) means that the mutant with y can invade the resident population with 
x and inevitably replace it. On the other hand, the case of (—, +) means that 
the mutant y cannot invade the resident x and any mixed state of strategies x 
and y leads to extinction of y. The case of (+, +) means that strategies x and 
y can invade mutually and there is uniquely a stable coexisting state. The case 
of (—, —) means that strategies x and y cannot invade each other, and thus, the 
monomorphic resident population with x is stable if the number of mutants 
is infinitesimally small. For a given point x under directional selection, the 
neighborhood of x always has two types of combinations, (+, —) and (—,+), 
in the front of and behind x along the direction of evolution, respectively. 
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Fig. 7 Geometric analysis of pairwise invasibility for IV = 5, r = 3, and a = 1. The point 
Q (0.5, pq) is a center surrounded by cyclic orbits (p q 0.5387). The focal points x are given 
by (0.7, 0.7), (0.3, 0.7), (0.2957,0.361), and (0.7043,0.361) in a, b, c, and d, respectively. 
These points ride on the same orbit C x and are located, respectively, in quadrants II, III, 
IV, and I around Q, which have different local arrangements of the two specific curves, 
Cm : S(x,y) = 0 and C r : S(y : x) = 0. The curves Cm and C r are tangent to each other at 
the focal point x. Cm is a hyperbola, and C r passes through Q. These curves are orthogonal 
to the orbit C x • Sign couplings, e.g. (+,—), means (sgn S(x, y), sgn S(y : x)). For instance, 
a rare mutant with y in the (+, — )-part is able to invade the resident population with the 
focal strategy x (because S(x,y) > 0); yet a rare mutant with x is not able to invade the 
resident population with y (because S(y,x) < 0). According to Appendix A.3, this indicates 
that the focal resident x can be replaced with any mutant in the the (+, —)-part. 
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Considering the signs of curvatures of C m and C r , local evolutionary dy¬ 
namics can be classified to four types, corresponding to the four regions I, II, 
III, and IV, as in the following list. Let us denote as C x the orbital curve at 
x, and as N x the line orthogonal to C x at x. 

I Cm is concave and C r is convex to the direction of evolution along the orbit 

C x . C r is located behind C m . We have (sgn S(x, y), sgn S(y, x)) = (—, —) 
at the gap between C m and C r - N x is in the gap and sandwiched by these 
curves. 

II C m is convex and C r is concave to the direction of evolution along C x . C r 
is located in the front of C m . We have (+, +) at the gap between C m and 
C r . N x is included in the gap. 

III Both C m and C r are convex to the direction of evolution along C x . C r is 
located behind C m . We have (—, —) at the gap between C m and C r . N x is 
located in the front of both C m and C r and within (+, —)-sign part. 

IV Both C m and C r are concave to the direction of evolution along C x . C r 
is located in the front of C m . We have (+, +) at the gap between C m and 
C r - N x is located behind both C m and C r and within (—, +)-part. 


4.3 Growth of the cloud and its collapse 
Invasion fitness for polymorphic populations 

We focus on stable dimorphism arising by (+, +)-part in II or IV. A mutant 
arising from the (+, +)-part for the focal point x is invasible to and can co¬ 
exist with x. So far, it has been assumed that the focal resident population 
is monomorphic. According to Appendix A.l, polymorphic populations with 
strategy distribution X are naturally mapped on monomorphic populations 
with strategy x* while the mapping 7 r keeps the invasion fitness unchanged: 

S(X,y) = S(x*,y). (14) 

The mapping x* = ( c x *,p x *) = i t(X) is given by that p x * = p x and c x * = 
c x + Cov(X)/p x in Eqs. (jA.9 1) and ()A.1Q|) . Equation (fl4l) means that arguments 
for monomorphic resident populations can extend to polymorphic resident 
populations by using the representative strategy x*. Coexisting patches of 
X must then be situated on the hyperbola C r * = {(c y ,p y )\S(x*,y) = 0} 
associated with x*; in particular, in the case of two patches, these are located 
on C r * across x*. 

Selection gradient for polymorphic populations 

To understand in depth how strategic diversification can affect the evolution¬ 
ary fate of populations, we would need to extend the selection gradient to 
polymorphic resident populations. We assume that a rare mutant is stochas¬ 
tically emerging around each patch of a resident population and the mutant’s 
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probability distribution is proportional to the frequency distribution of the res¬ 
ident population. Let X = {{x^ ,k be the distribution of a polymor¬ 

phic resident population with finite support, where Xi = (c x .,p x .) and each rii 
denotes the relative frequency of strategy Xi with ^2 1<i<K ni = 1. We then em¬ 
ploy the mutant’s distribution Y related to X, such that Y = {(yi,rii)}i = i ? ... 
where any yi(= (c yi ,P yi )) is sufficiently close to X{. 

To predict evolutionary trajectories after diversification, we define an inte¬ 
grated selection gradient for the averaged strategy of the resident distribution 
X, x = (c x ,p x ), as a weighted sum of the selection gradient induced by each 
mutant strategy yi arising near that is, 


D(x) := 


where 


dS(X, Vi ) 


da 


Vi 


dS(X, Vi ) 


dp Vi 


Vi=Xi 


Ui=Xi 


,K dS(X, yi ) 

H=1 dCyi 

\ 



Vi=Xi 

(15) 

'K dS(X, Vi ) 

Jl=l 1 Qpyi 

) 

Vi=Xi / 


aio{x*) + an(x*)(p Xi -p x >), 

(16) 

aoi(x*) + au(x*)(c Xi - c x *). 

(17) 


Then, Eq. (ITK1) is rewritten as 

aio(x*) 


D(x) = 


aoi{x*) - an(x*) 


Cov(X) = 


Px 


a w (x) 
a 0 i(x) + G(z x )Cov(X) 


where z x = 1 — p x , and 


g «=— 1 


1 — z 


N 


N{l-z) 


> 0 for all z in [0,1]. 


(18) 


(19) 


If X is monomorphic, Cov(X) = 0, and hence, Eq. ([7]) is recovered. Monomor- 
phic and polymorphic populations differ in the additional terms, —an(x*)Cov(X)/p x 
and G(z x ) Cov(X) in Eq. which would lead to some changes in orbits 

along which the average strategy x travels. 

We have analyzed in Sect. 4.2 that there is a chance of polymorphism along 
a normal of the selection gradient in the quadrant II or IV. Thus, the slopes of 
the normals are negative, and also is the resulting covariance between the two 
traits Cov(X). This leads to such that a diversified population (and its average 
strategy) in II and IV can turn in and out of those former orbits, respectively, 
as in Eq. ([15]) . In the case of the quadrant I or III, there is no (+, +)-part and 
thus a rare possibility to maintain dimorphism that resulted from mutations. 

As such, it is not required to consider the effects of the additional term in Eq. 
m in I and III. From these arguments, we could state that there is a specific 
region of the strategy space in which populations tend to be with the negative 
covariance and are likely to be pulled into inner orbits. 
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Singular strategies for polymorphic populations 

From Eq. (fl8l) we understand that Q is an equilibrium point even if X is 
polymorphic. Here we investigate the stability of the population with x* = Q. 
We calculate the Jacobian of the selection gradient D(x ) in Eq. ([T8]) with 
respect to ( c x *,p x *). Considering that Co v(X)/p x = c x * — c x is independent 
of p x *, F( 1 — pq) = 0, and (r — 1 )cq — a = 0, we obtain 



( 20 ) 


Theorem 1 The center Q is stable if and only if Cov(X) < 0. 

Proof Since 0 < pq < 1 and F'( 1 — Pq) < 0, the off-diagonal elements of 
J\ X *=Q are of opposite sign and the remaining diagonal element has the same 
sign as Cov(X). Thus, we have that det J\ x * = q > 0 and that the sign of 
tr J\ x * = q is the same as Cov(X). The stability of the representative strategy at 
Q, x * = Q, is extensively analyzed, as follows: if Cov(X) > 0, then tr J\ x * =Q > 
0 and det J\ x * = q > 0, and hence, Q is unstable; otherwise, if Cov(X) < 0, 
then tr J\ x * = q < 0 and det J\ x * = q > 0, and hence, Q is stable. □ 

In the individual-based simulations the symmetry of distribution is hardly 
maintained when considering mutations. After the symmetric distribution 
breaks, if Cov(X) < 0, the representative strategy x* would stay at Q. Since 
x* = Q leads to a situation where any mutant can invade the population 
by neutral drift, the population is likely to continue spreading as long as the 
negative covariance is maintained. This process would lead the distribution 
to evolve into a diagonally spread form with a negative slope, actually as is 
demonstrated by the numerical investigations. If Cov(X) > 0, then x* will go 
away from Q. When x* ^ Q, cloud-like populations diversified through neutral 
drift would shrink into a shape determined such that S(X, xf) = S(x* ,Xi) = 0 
for any patch Xi of X. 

5 Discussion 

We investigate a model for understanding the evolution of cooperation among 
individuals in free and anonymous societies. It is well known in discrete- 
strategy models that voluntary participation plays an important role in main¬ 
taining the level of cooperation p~3lll4U52ll53U54[[55l[56l[57ir58U59U6Q] as well as 
in promoting the evolution of costly punishment for collective actions eh 
I62ll63ll64ll65ll66 [1671168] (see also [69]). There are a handful of prior theoreti¬ 
cal studies about the co-evolution of continuous investment in public good 
games and other continuous properties, such as costly punishment (severity, 
strictness, tolerance, etc. ) mm- in particular Shimao and Nakamaru EB 
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considered the evolution of graduated punishment in well-mixed populations 
and demonstrated the possibility of strategy diversification. Yet, little has been 
known about the consequences of continuously varying participation probabil¬ 
ity. We have analyzed gradual co-evoution of participation probability in the 
continuous public good game and shown that the evolutionary dynamics is 
characterised three phases: osciallation, convergence, and unchecked strategy- 
diversficiation and collapse to a single strategy. 

Despite being a simple model set in well-mixed populations, the contin¬ 
uous voluntary public good game is capable of a wide variety of evolutionary 
scenarios, roughly classified into oscillations (rock-scissors-paper cycle) and 
dispersal (emergence of the specific correlation among the traits). We fully 
analyze the adaptive dynamics for monomorphic populations for the model. 
We remark that the dynamics obtained are qualitatively different of those for 
discrete voluntary public good games mm (see also [72[ for effects of small 
populations in the discrete games). In the discrete case oscillations occur in 
population compositions (fractions of cooperators, defectors, and nonpartici¬ 
pants). However, in the continuous case oscillations occur in individual traits 
(levels of cooperation and participation if individuals). The cyclic movement 
along periodical closed orbits could be described as in a rock-scissors-paper 
cycle: if most strategies are cooperative, it would be profitable to reduce in¬ 
vestment; if more defective strategies are prevalent, it would be better to more 
frequently exit; if most individuals tend to be nonparticipants at most times, 
then small interaction groups form most frequently, in which case increasing 
in the cooperation and participation levels is more beneficial than otherwise. 
We note that the theoretical results, depicted in Fig. [6j continue to hold even 
if a single participant would benefit from the good provision, instead of the 
loner’s payoff a. See Appendix A.4 for details. 

We have analyzed the unfolding evolutionary dynamics using the theory of 
adaptive dynamics. This worked well for understanding the initial oscillatory 
phase in which individual levels of cooperation and participation gradually 
converged to a singular center Q. At this point, the invasion fitness vanish en¬ 
tirely and all mutant strategies have the same expected payoff as the resident 
strategy. This can be understood as an instance of the Bishop-Cannings theo¬ 
rem m in evolutionary game theory. To understand the dispersal phase that 
ensues, we established a condition for mutual invasibility of nearby strategies 
and showed that strategy diversification can continue as long as the covari¬ 
ance of individual cooperation and participation levels is negative. While the 
process of diversification may continue for quite some time, random drift even¬ 
tually results in imbalances and the manifestation of positive covariance. At 
this point, the cloud of coexisting strategies unexpectedly collapses and the 
process begins anew. 
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Appendix A 

A.l Invasion fitness 

Here we first calculate the expected payoff of a mutant within a monomorphic or polymorphic 
resident population with finite support. We then introduce the invasion fitness of a mutant 
extended to being with a probability distribution. 


For monomorphic populations 


The probability that the rare participating mutant (we assume, of the infinitesimally small 
frequency) finds no co-participant and N — 1 nonparticipants from the resident population 
with (c x ,p x ) is (1 —Pcc)^ -1 - In the case by assumption the public good games does not hold 
and the single participant only earns cr. Or otherwise, the mutant player should find from the 
resident population S — 1 co-participants and N — S nonparticipants with 2 < S < TV, with 
probability (^Zi)Px _1 (l — Px) N ~ S • Hence, the mutant will obtain the net benefit through 
the participation, jg((S — 1 )c x + c y ) — c y . The payoff of the rare participating mutant is 


g{x,y) 


(i - P.r- 1 - +e GljK" 1 (1 - p ^ N ~ s 

(1 ~Px) N ~ 1 cr+ E (g_^) ^Px~ 1 ( 1 ~Px) N ~ S r(c y - c x ) 



N AT 1 

+ E (ob ) p *“ 1(1 ~P*) N ~ S ( rC * - C v) 

S =2 


(i -p x y 


1 V' ( N \ 

nJ^Ss ) 1 


If 


(1 -p x ) N S r(c y — c x ) 


+ E (VK a -Pxr-^- S \rc x -c v ) 

S' = i b 

(1 - Px) N ~ 1 o- + (1 - 2±>. -(1 - p*)^ -1 ) r{c x - Cy) 

+ (1 - (1 - Px) N ~ 1 )(rc x - Cy) 

(1 - p x ) N ~ 1 cr + (1 - (1 - Px) N ~ 1 )(r - 1 )c x - ( Cy - c x )F( 1 - p x ), (A.l) 


where ^ = Cs) anc I F( z ) * s as i n Eq. ([5]). This yields the mutant’s payoff P(x,y) 

in Eq. 0} and the invasion fitness S(x,y) in Eq. JSJ. 


For polymorphic populations 

We consider a polymorphic resident population consisting of different K patches (1 < K < 
oo), denoted as X = {(xi, Ui)}z=i,--- ,k> where Xi represents a two-dimensional strategy 
given by Xi = (c x i,p x i) and rii represents the relative frequency of strategy Xi. Thus, ni > 0 
and Y2u=i n i~ 1- Let us, * n general, denote by P(X , y) the expected payoff of an individual 
with strategy y = ( c y ,p y ) interacting with other N — 1 individuals randomly selected from 
the polymorphic resident population X. As well, g(X, y) denotes the individual’s expected 
payoff when the individual participates with probability p y . Hence, 


P(X, y) = Pyd{X , y) + (1 - p y )a, 


(A-2) 
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As well as in the case of monomorphic populations, thus, the invasion fitness for the rare 
mutant within the polymorphic resident population is defined as 

S(X,y) = P(X,y)-P(X), (A.3) 

in which P(X) describes the average payoff over the polymorphic resident population, given 
by Yn =1 riiP(X,Xi). 

We next estimate the probability that the focal participant with y = ( c y ,p y ) finds from 
the resident population S — 1 co-participants and N — S nonparticipants. In the case S = 1 
(no resident participates), the focal participant obtains the payoff cr by assumption. This 
happens with probability ni( 1 - Pxi )) N ~ 1 = (1 -Pcc)^ -1 , where p x := n iPxi- 

Meanwhile, in the case S > 1, the event probability of that is given by 


E (. 


S -1 

s 1,- • •, S K 


=5-1, 


n ( n j px 

3 = 1 


0 


E 


tiH-l-tx 

=N — S, 
*k> 0 


N-S 

I," 1 ) 


ii(»«a-*-»**. ( a - 4 ) 


0 


where the terms 0 and | b | denote the probabilistic sum of combination of AT-type strategies, 
respectively, among S — 1 participants and among remaining N — S nonparticipants. With 
the combination of participants in Eq. (1A.4D , (si, • • • ,s^), the focal participant earns 



Considering the event probability, thus, the focal participant’s expected payoff is 


(A.5) 




; ^ ^ s k c xk + c y f ~ 1 


- C:;)0 
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S- 1 


S f —' *—' \si, • • • ,sk- \ ■ , 

k=l si H-b s K Vj = l 
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>0 
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Y[( n jPxj) Sj S k C xk 




(A.6) 


From the multinomial series expansion, the terms | a | and | b | are identical to (nip^i + • • • + 

nKPxK) S ~ 1 =Px~ 1 and (rn(l-p x i)-\ - Vn K (l-p xK )) N ~ s = (l-p x ) N ~ s , respectively. 

Since ( 5-1 )s k = ( S ~^ )(5 —1) for 1 < \/k < AT, the term \~c] in Eq. 

V S1,- ,S k ,-" ,S K ' K ,S k -l,— ,S K J V ) - - ’ |-1 H 

(IA.6I) can be rewritten as 
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(where s k := s k — 1 ) 
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Thus, we obtain the analytical expression of y(X, y), as follows: 


g{X,y) = (1 -p x ) N 1 <t+ ^2 (^_ *)(1 ~Px) N S pf ~ Y niPxiCxi 

” ” i= 1 


5=2 
N 


5=2 
N 


- a -m»- v + e c: ■» (i - o+^ 


r(5 - 1) v-^ nip xi 


;=i P x 


= (l-p x ) N V+ 


5=2 


■AT - 1 
5-1 






W'iPxi 


_i Px 


c xi \ c y] c y 


■ (A.8) 


We note that Eq. (TOli can be applied to the case that the rate mutant y = ( c y ,p y ) has 
a small yet finite mass e > 0, with considering the mutant’s patch (x^+i, ^ic+i) = (y, e) in 
the resident population of K + 1 patches, X = {(xi,rii)}i = p... x+i with X > 1. It is clear 
that as e —» 0, we can recover Eq. fOli for the rare mutant with the infinitesimally small 
mass and the resident with K patches; in particular Eq. (IA. II) for K = 1. 


Mapping polymorphism to monomorphism 


This yields a natural mapping from polymorphic populations to monomorphic populations, 
such that it keeps the expected payoff of a mutant unchanged. Let us put 


c 


X* 


K 


: =E 


n iPxi ^ 

I c xii 
Px 


Px * ■= Px , 


(A.9) 

(A.10) 


which define a mapping from the set of polymorphic populations with finite support to the 
set of monomorphic populations, as follows: 

7T : X i —y x* := (c x *,p x *)• (A.11) 

Using this, we represent y(X, y) in Eq. (IA.8D , as follows: 


g(x,y) = (i -p x *) N 1 <r+ ^2 1 )px*' s ' 1 (i-Px*) N s 

5=2 ^ i 

= (1 - Px + (1 - (1 -Px*) N ~ 1 )(r - 1 )c x * - (Cy - c x *)F( 1 - p x *), (A.12) 

where F(z) is in Eq. J5). In particular, if a resident population X is monomorphic with 
strateev x , Eq. (IA.12D is consistent with the former Eq. ED. that is, y(X, y) = g(x*,y) 
and thus P(X, y) = P(x*,y). Therefore, in this continuous-strategy game, the expected 
payoff of a mutant within any polymorphic residents with finite support can be calculated 
by using the mapping n in Eq. rrm Let us clarify the difference between the strategy 
x* = ( c x *,p x *) and the average strategy x = (c x ,p x ) given by E£i n i c xi, Y,f=i n iPxi)- 
Obviously, p x * = p x , yet 


r((S - l)c x * +c y ) 
S 


c x — 


1 { c xi C X j)(p X i Pxj ) _ Cov(c x ,p x ) 


— i n iPxi 


Px 


(A.13) 


Extend to polymorphic mutants 

Moreover, we extend the expected payoff to a mutant with probability distribution with 
finite support, as resident populations. Let us represent the mutant’s distribution as Y = 
{(yi, ^i)}i<KK', where yi = ( c y i,p y i ) and mi is the relative frequency of strategy yi 
(1 < i < K'). We define the expected payoff of a mutant with distribution Y in a resident 
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population with distribution X, by weighted sum of the expected payoff of Y’s each patch, 
as follows: 

k' k' 

P(X,Y) := E rriiP(X, m) = ^ miP{x*, m). (A.14) 

i= 1 i= 1 

From Eq. (IA7T2T) . 

k' 

E miPyig(X : yi) 

i= 1 

( ^2i=l m iPyi c yi 

\ Sz=l m iPyi 

= Py*g(X,y*), (A.15) 

where y* = (c y *,p y *) is given by 7r(Y) = {Yjf=i rn iP y i^Yjf=i rn iPyi c yil Yjf=i rn iPyi)‘ 

Thus, we obtain 

k' k' 

5 ~2miP(x*,yi ) = ^ ~2mi(Pyig(X : yi ) + (1 ~ P y i)cr) 
i= 1 i= 1 

= Py*9(X,y*) + (1 -Py*)v 

= P(x*,y*), (A.16) 

and then, 

P(X,Y) = P(7r(X),n(Y)). (A.17) 

Finally, we define invasion fitness in the case that the mutant and the resident population 
have strategy distributions with finite support, respectively Y and X. Similarly, invasion 
fitness is given by 

S(X, Y) = P(X, Y) — P(X, A), (A.18) 

Substituting Eqs. (IA.3I) and (IA.Ill) into Eq. (IA.18I) . we can have the Taylor expansion around 

X = ( C X* , Px* )’• 

S(X,Y) = -p x *F(z x *)(c y * - c x *) + ((r - 1 )c x * - cr)(l - (1 - p x * ) N ~ 1 )(p y * ~ Px*) 

-F(z x *)(c y * -c x *)(p y * -p x *). (A.19) 


F(l Px *) 


K' 


= E 


W^iPyi 


(1 -Px*) N 1 cr+ (l-(l-p x *) N 1 )(r — l)c x 


A.2 Curvatures 


At a given focal point jc, the curves Cm and C r have identical slopes. To determine the local 
arrangement of Cm and C r around x, thus we need to calculate those second derivatives, 
that is, curvatures. In the case of Cm, we have 


Py( x ) 



(A.20) 


and then the curvature of Cm at x is given by K rn (x) = p y (x i)[l + p y (x)] 3 / 2 , where p' y (x) = 
dp y /dc y \ y = x = —p x cLii(x)/aoi(x). In the case of C r , we have 


Py (x) = 2p x ^ (a' 01 (x) +p x F'(l -p x )) , (A.21) 

a oi ( x ) 

where a' Q1 (x) = daoi (y)/dc y \ y=x - We can then calculate the curvature K r (x) of C r at x, as 
well as Km(x). 















Continuous voluntary public good games 


25 


Let us investigate the signs of /c m (x), K r (x), and K r {x) — Km(x) given by 
2 Px 


\l+p'Jx)} 3 / 2 


( an ^ ) (“01 ( x ) + PxF'{l - Px) - oil (a:)) (A.22) 

Vaoi(x)/ 


From Eq. (IA.20D , the sign of Km(x) is always positive. As for the sign of K r (x), we should 
have a further calculation in the Eq. (IA.21D , as follows: putting z x = 1 — p x , 


a oi( x ) + (1 - z x )F'(z x ) 
= -(l-z»- 1 )+r(l- 


1 -z£ 


1 + 


(N - 1)(1 - z x )z£ 


N( 1 - z x ) 


1-4 

N 


1 + 


(N-l)(l-z x )z* 
1 -z™- 1 


(A.23) 

where all the terms are positive if z x ^ 1, and otherwise zero. We note that 

= (1 - z x ) 2 [(TV - 2)(1 + ■ ■ • + z»~ 3 ) + • ■ • + (N - 2fc)(^- 1 + • ■ ■ + 4 JV_2)_fc ) 

if N is even, 
if N is odd, 


iV _o JV_ 

2(^cc 2 + ^a? ) 


N —3 
Z 2 


> 0 


(A.24) 


Thus, the sign of K r (x) is equal to the sign of an (x). As for the sign of K, r (x) — Km(x ), from 
Eqs. (IA.20D and iron . we need to know the sign of the term as follows: 

a' 01 (x) + (1 - z x )F'(z x ) - an(x) 

(1 z N-1 ) + 2 ( 1 1 -^ ^ | (N-l)(l-z x )z»-* ( J. 

( " H l N(l-zx))) + m 


N(l-z x ) 


(A.25) 


From Eq. (IA.24D , the above is positive if z x / 1, and otherwise, zero. Therefore, the sign of 
K r {x) — Km(x) is equal to the sign of an(x), as well as K r (x). 


A.3 Replicator dynamics for two strategies 

We analyze frequency dynamics between two strategies with x\ = (ci,pi) and X 2 = ( 02 ,^ 2 )- 
We assume that the growth rate of strategy is determined by the replicator dynamics. It 
has already been studied in a special case of c\ — 0 and C 2 = 1, that is, consisting of full 
defection and full cooperation which are extended to be with probabilities to participate 
in the public good game E2- The replicator dynamics in the special case have been clas¬ 
sified into four fundamental types of evolutionary scenario in two-strategy games, given by 
dominance, coexistence, bi-stability, and neutrality. Here we present a general classification 
for two arbitrary strategies x\ and X 2 in the strategy space U. It then turns out that sim¬ 
ilarly, the evolutionary scenario can be determined by the combination of signs, given by 
(sgn S(x 2 ,xi), sgn S(x i,x 2 )). 

Let us denote as X ^ a mixed state between x\ and X 2 , with relative frequencies h and 
h — 1 respectively. To investigate the evolutionary fate of such the dimorphic population, we 
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should know the payoff difference between x\ and x 2 in the environment set by the mixed 
state Xh, that is, the advantage function given by 

P(X h ,x i) - P(X h ,x 2 ) =: F 12 (h), (A.26) 


where P(Xh, xi) denotes the expected payoff of strategy xi (i = 1,2) within the mixed pop¬ 
ulation Xh. The average payoff over the population is given by P(X^, X^) = hP(Xfr,x i) + 

(1 — h)P(Xfr, x 2 ). Using the relative average payoff S(Xh,Xi) := P(X^,Xi) — P(Xh,Xh) 

(i = 1, 2), we obtain 

F 12 (h) = S(X h ,x 1 ) - S(X h ,x 2 ), (A.27) 

in particular, 

Fi 2 (0) = S(x 2 ,xi), Fi 2 (1) = — S(xi, x 2 ). (A.28) 

The replicator equation is given by 

h = h(P(X hiXl ) - P(X h ,X h )) = hS(X h , Xl ) 

= h(l - h)(P(X h: x 1 ) - P(X h ,x 2 )) 

= h( 1 - h)F 12 (h). (A.29) 

From a straightforward calculation, Fi 2 {h) can be rewritten as 

r ( 1 

Fi 2 (h) = [(ci - cq )pi - (c 2 - cq )p 2 \ (r - 1)(1 - z™- 1 ) + (c 2 - ci)pip 2 -- 1 _ T77 

s V v ^ s V ^ -f Z h \ A( 

(A) (Zl) (B) >-v- 

(Z2) 

(A.30) 



where = 1 — = 1 — (hpi + (1 — h)p 2 ) and cq = • In particular, if pi = p 2 (=: p), 

Eq. tOol is reduced, as follows: 


Fi 2 (h) 


(c 2 -ci)p 


-(r-l)(l-z N ~ 1 ) + r 


l-z N \ 
N(l-z)J 


(C2 -Ci)p-F(z), (A.31) 


where z = 1 — p which is independent of h. In the reduced case, thus F\ 2 {h) must constant 
and the replicator dynamics is unilateral toward either of the two extreme states. Which one 
is a global attractor depends on two kinds of magnitude relation: c\ and c 2 ; and, if r > 2, 
also p and pq, where pq is the unique interior root of F(1 — Pq). If p = 0, the dynamics is 
neutral. In the following section we consider the general case: pi / p 2 . 

We first consider this general case that both (A) and (B) are non-zero. If the boundary 
values Fi 2 (0) and Fi 2 (1) have signs that are opposite to each other ( «<==> S(x 2 ,x 1 ) and 
S(xi,x 2 ) have same signs, from Eq. iTOsU Fi 2 {h) has to have at least one interior root 
within [0,1]. In the case we show that F\ 2 {h) is monotonic and thus the interior root is 
unique, as follows. Since there exists h such that Eq. tP9l = 0 holds, the term (A) < 0, 
if the term (B) > 0 c 2 > ci), or the term (A) > 0, if the term (B) < 0 (■<=>• c 2 < ci). 
Differentiate F\ 2 {h) with respect to h , 


dF\ 2 _ dF\ 2 dzh 
dh dzh dh 


((ci - c Q )pi - (c 2 - c Q )p 2 ) • - (r - 1 )(N - 1 )z£ 


(A) 


(Zl’) 


+ (c 2 - ci)pip 2 -((N-2) + 2(N-3)z h + - ■ - + (N — 2)z n ~ 3 ) 
" --- 'FI 


(B) 


(Z2’) 


(P2 ~Pl)- 


(A.32) 
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Since the term (Zl’) < 0 and the term (Z2’) > 0 for all t E (0,1), 


dFi 2 f > 0 if (ci - c 2 )(pi - P 2 ) > 0 , / A 33 x 

dh [< 0 if (ci — c 2 )(pi — p 2 ) < 0 . ^ 

Therefore, F\ 2 (h) is monotonic and the interior root is unique if it exists. If (sgn5(iC2> #i)> sgn5(aq, x 2 )) 
is we have that id 2(0) < 0 and Fi 2 (1) > 0 in Eq. (IA.28l) h and the monotonicity 

leads to that F\ 2 {h) is increasing. Thus the interior fixed point exists and is a repellor 
(“bi-stability”). If (sgn S(x 2 , x±), sgn S(x±, x 2 )) is (+,+), similarly, ib.2(0) > 0, -Fi 2 (l) < 0, 
and Fi 2 (h) is decreasing. Thus the interior fixed point exists and is an attractor (“coexis¬ 
tence”). If (sgn S(x 2 , xi), sgn S(x±, X 2 )) is (+,—), we have that both F 12 and Fi2(l) > 0. 

Thus, Fi 2 (h) has no interior root and the uniform state with x\ is a global attractor (“aq- 
dominance”). Finally, if (sgn S(x 2 , aq), sgn 5(aq, aq)) is (—,+), then that both id 2 and 
-^ 12 ( 1 ) < 0. Similarly, thus there exists no interior root and the other uniform state with x s 
is a global attractor (“aq-dominance”). 

We turn to the boundary cases. Let us first assume that only (B) equals zero. It follows 
that (B) = 0 <==> ci = C 2 , pi = 0 or p 2 = 0. In the case of ci = C 2 (=: c), Fi 2 (h) is 
reduced to 

Fi 2 (h) = (c-c Q )(p 1 -p 2 )(r - 1)(1 - z%' _1 ). (A.34) 

The sign of Fi 2 (h) above is unchanged, and thus the direction of dynamics is unilateral. 

A global attractor is determined by the sign of (c — cq)(pi — P2)- Similarly, in the case of 
P 2 = 0, if ci > cq, the dynamics is aq-dominance, or otherwise, aq-dominance; in the case 
of pi = 0, if C 2 > cq, the dynamics is ^-dominance, or otherwise, aq-dominance. If only 
(A) equals zero , it follows from Eq. (IA.32D that the dynamics is a? 1 -dominance if C 2 > ci, or 
otherwise, aq-dominance. Finally, if both (A) and (B) equal zero, the dynamics is neutral. 


A.4 Continuous voluntary public good games with stand-alone play 


We examine continuous public good game with stand-alone play. We assume that a single 
participant with contribution level c would receive rc — c from the good provision, instead 
of the loner’s payoff a. In this case it is clear that if the contribution level is greater than 
cq = cr/{r — 1), nonparticipation is no longer individually rational: each point of the line 
p = 0 is no longer a Nash equilibrium. As in Sect. 2.2, the probability that a mutant 
player with strategy y finds itself among the 5 — 1 resident co-players with strategy x is 
(^Zi)Px -1 (l — p x ) N ~ S 1 yet the number of players S can vary between 1 and N. Thus, Eq. 
(TO) turns into 


9{x,y) 



r((S - l)c a + Cy) 

S 



{r 1 )c x ( Cy c x )Fq( 1 p x ). 


(A.35) 


where Fo(z) = 1 — r(l — z n )/(N(1 — z)). We note that for 1 < r < N, Fo(z) is monotonically 
decreasing and has a unique root in the open interval (0,1). Hence, using cq = cr/(r — 1), 


P{x, y) = a + (r - 1 )(c x - cq)p v - ( c y - c x )p y F 0 ( 1 - p x ). (A.36) 


Indeed, this yields a similar system, as follows: c = —pFo( 1 — p) and p = (r — l)(c — cq). in 
contrast to the original system, the variant system is so simple that has only two singular 
points, a center point and a boundary saddle point with p = 0. This center point exists for 
all r within 1 < r < N. 
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